A New Dataset and Evaluation for Belief/Factuality
نویسندگان
چکیده
The terms “belief” and “factuality” both refer to the intention of the writer to present the propositional content of an utterance as firmly believed by the writer, not firmly believed, or having some other status. This paper presents an ongoing annotation effort and an associated evaluation.
منابع مشابه
Integrating Deep Linguistic Features in Factuality Prediction over Unified Datasets
Previous models for the assessment of commitment towards a predicate in a sentence (also known as factuality prediction) were trained and tested against a specific annotated dataset, subsequently limiting the generality of their results. In this work we propose an intuitive method for mapping three previously annotated corpora onto a single factuality scale, thereby enabling models to be tested...
متن کاملFactuality Drift Assessment by Lexical Markers in Resolved Rumors
Our study presents a social media content representation, visualization and assessment method for modeling the emergence and resolution of rumorous claims during crisis events. Interpreting the factuality with which a claim is expressed is typically context-dependent and can be subject to semantic drift. We identify and quantify temporally anchored distributional and polarity patterns of lexica...
متن کاملHope and Fear: Interpreting Perspectives by Integrating Sentiment and Event Factuality
Both sentiment and event factuality are fundamental information levels for our understanding of events mentioned in news texts. Most research so far has focused on either modeling opinions or factuality. In this paper, we propose a model that combines the two for the extraction and interpretation of perspectives on events. By doing so, we can explain the way people perceive changes in (their be...
متن کاملEvaluation of Updating Methods in Building Blocks Dataset
With the increasing use of spatial data in daily life, the production of this data from diverse information sources with different precision and scales has grown widely. Generating new data requires a great deal of time and money. Therefore, one solution is to reduce costs is to update the old data at different scales using new data (produced on a similar scale). One approach to updating data i...
متن کاملThe EVALITA 2016 Event Factuality Annotation Task (FactA)
English. This report describes the FactA (Event Factuality Annotation) Task presented at the EVALITA 2016 evaluation campaign. The task aimed at evaluating systems for the identification of the factuality profiling of events. Motivations, datasets, evaluation metrics, and postevaluation results are presented and discussed. Italiano. Questo report descrive il task di valutazione FactA (Event Fac...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2015